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INTRODUCTION 



The notion of using a small set of relevant expecta- 
tion values so as to describe the main properties of 
physical systems may be considered the leit-motiv 
of statistical mechanics Developments based 
upon Jaynes' maximum entropy principle (Max- 
Ent) constitute a pillar of our present understand- 
ing of the discipline 0, H- This type of ideas 
has also been fruitfuly invoked for obtaining the 
probabihty distribution associated to pure quan- 
tum states via MaxEnt (see for instance [1] and 
references therein). Indeed, MaxEnt constitutes 
a very important physical viewpoint, on the one 
hand, and powerful technique on the other one. 
This is true not only for physics, chemistry, as- 
tronomy, and engineering but for a host of other 
disciplines as well 0- Thus, MaxEnt extensions 
that amplify its range of applicability should be 
regarded as significant for all branches of science. 

In this communication we wish to introduce the 
powerful Convex Operational Models (COM) ap- 
proach 0-01 into the MaxEnt domain. COM is, 
in turn, intimately linked to convex sets of proba- 
bility measures 0-[TT[. Among the several extant 
approaches to the study of convex sets of probabil- 
ity measures, the above cited references deal with 
the COM-technique, in which physical states (un- 



derstood as probability measures) and their convex 
structure play a key role, while other related quan- 
tities emerge in rather natural fashion. There ex- 
ist generalizations of quantum mechanics, includ- 
ing non-linear versions, that are axiomatized using 
the convex structure of the set of states (see [T3| , 
[Oj . and [I3|)- Using convex sets one treats in 
geometrical fashion the statistical theory of sys- 
tems, and can also include quantum and classical 
mechanics (indeed several other theories as well). 
Elementary (sharp) tests in quantum mechanics 
are represented by projection operators that form 
the well known von Newmann's lattice, an ortho- 
modular one [13 . Vis the Born's rule any pro- 
jection operator defines probabilities. These are 
linked to measures over the von Newmann's lat- 
tice: using Gleason's theorem, it is possible to 
link in a bijective way density matrixes and non- 
kolmogorovian probability measures. But proba- 
bility measures may also arise in quantum mechan- 
ics by means of positive operator valued measures 
(POVMs), which are also known as generalized 
measures. POVMs are also generalized easily to 
any COM. We will review these subjects in Sec- 
tion [flll 

We will express here Jaynes 's MaxEnt appproach 
to a lattice theoretical form, and using this, extend 
it to arbitrary COM, which entails a considerable 
enlargment of its scope. The extension is done in 
such a way that includes conditions on POVMs. 



2 



This is done in Sections llVl andlVl Such generahza- 
tion win undoubtedly be of interest to thousands 
of MaxEnt practitioners. Since COMs constitute 
important extrapolations to larger settings of any 
statistical theory, casting MaxEnt for any COM, 
after expressing Jaynes' principle in a geometrical 
and lattice theoretical scenario, will hopefully open 
the door to a new systematization of the principle 
while shedding light into its geometrical structure. 



Ao = In Z. (5) 

Such simple-looking algorithm constitutes one of 
the most powerful ones in physics' arsenal. In a 
quantum setting, of course, the i?'s are operators 
on a Hilbert space H. while p is a density matrix 
(operator). 



II. MAXIMUM ENTROPY PRINCIPLE 
(MAXENT) 

Statistical mechanics and thereby thermodynamics 
can be formulated on the basis of information the- 
ory if the density distribution p[x) is obtained by 
recourse to MaxEnt 0, (3- Jaynes' stance asserts 
that assuming that your prior knowledge about the 
system is given by the values of n expectation val- 
ues of physical quantities i.e., . . . , (i?„), 
then the most unbiased probability distribution 
p(x) is uniquely fixed by extremizing Shannon's 
logarithmic entropy S subject to the n constraint 

= ri\ for all i. (1) 

This brings into the game n Lagrange multi- 
pliers A^. In the process of employing the Max- 
Ent procedure one discovers that the information 
quantifier S can be identified with the equilibrium 
entropy of thermodynamics if our prior knowl- 
edge . . . , (i?n) refers to extensive quantities 
[2]. S {maximal) , once determined, yields com- 
plete thermodynamical information with respect 
to the system of interest [2]. The MaxEnt proba- 
bility distribution function (PDF), associated to 
Boltzmann-Gibbs-Shannon's logarithmic entropy 
S, is given by 0,3 

Pmaa; = exp[(-Aol - Aii?i A„i?„)], (2) 

where the A's are Lagrange multipliers guarantee- 
ing that 



r. = -^lnZ, (3) 
while the partition function reads 

Z(Ai • • ■ A„) = tr[exp-^i^i--^"«"], (4) 
and the normalization condition 



III. COM-PRELIMINARIES 

We recapitulate here essential aspects of convex 
operational models. V{%) will denote the set of 
all closed subspaces of which are in a one to 
one correspondence with the projection operators. 
Because of the one to one link, one usually employs 
the notions of "closed subspace" and "projector" 
in interchangeable fashion. The bounded opera- 
tors on Ti. will be denoted by B{H). We begin the 
present task with reference to classical probabili- 
ties. Given a set fi, let us consider a tr-algebra 
S C 7'(il). Then, a probability measure will be 
given by a function 

M:S^[0,1], (6) 

which sa tisfi es the well known axioms of Kol- 
mogorov [Itjlj . As for quantum probabilities we 
remind that, in the standard formulation of quan- 
tum mechanics, states may be defined as functions 
of the form [T71 

s:P(H)^[0;l], (7) 

such that: 

1. s(0) = (0 is the null subspace). 

2. S{P^) = l-s{P) 

3. For any pairwise orthogonal denumerable 
family of projections Pj one has 

s{j:,p,)^e,s{p,) 

For a study of the differences between classical 
and quantum probabilities, see [lllj (chapter 2). 
Moreover, Gleason's theorem [T^, [T3] asserts that 
if dim{'H) > 3, then the set of all measures of the 
form ([7]) can be put into a one-to-one correspon- 
dence with the set C of by all positive, hermitian, 
and trace-class (normalized to unity) operators in 
B{T-L). If P e 'P('H), the correspondence between 
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e C and its induced probability measure is given 

y 

Sp(P)=tr(pP), (8) 

where tr(- • • ) stands for the trace operator in 
B{T-L), i.e., the sum of all the eigenvalues. Equa- 
tion is essentially Born's rule. Any p £ C may 
be written as 

p = ^p,P^,, (9) 

i 

where the P^^ are one dimensional projection op- 
erators on the rays (subspaces of dimension one) 
generated by the vectors ipi and Pi — ^ {Pi > 0). 
Thus, it is clear that C is a convex set. If the sum 
in ^ is finite, then p is said to be of finite range. 
Remark that in the infinite dimensional case the 
sum in Q may be infinite in a non-trivial sense. 
C is then a set of non-boolean probability mea- 
sures, closed by convexity, that is also closed in the 
norm of H. Let us remind the reader that a lattice 
is a partially ordered set (also called a poset) in 
which any two elements have a unique supremum 
(the elements' least upper bound; called their join) 
and an infimum (greatest lower bound; called their 
meet). Lattices can also be characterized as alge- 
braic structures satisfying certain axiomatic iden- 
tities. Since the two definitions are equivalent, lat- 
tice theory draws on both order theory and univer- 
sal algebra. Semilattices include lattices, which in 
turn include Heyting and Boolean algebras. These 
" lattice- like" structures all admit order-theoretic 
as well as algebraic descriptions 22]. 
A very important notion for our purposes is that 
of Cc, the set of all convex subsets of C. Any el- 
ement of Cc will be itself a "probability space", 
in the sense that it is a set of non boolean proba- 
bility measures closed under convex combinations 
(not to be confused with the usual mathematical 
notion of sample space) |23] . It can be shown that 
Cc is endowed with a canonical lattice theoretical 
structure that can be related to quantum entangle- 
ment and positive maps ppj . The meet operation 
is given by set intersection, the join by convex hull 
and the partial order by set inclusion. We will use 
this lattice in order to express the Max-Ent proto- 
col in a different (but equivalent) form. It should 
be also clear that the lattice operations mentioned 
above may be trivially defined in any COM and 
this will be used in Section Ivl 
A general (pure) state can be written as 

(10) 



and we denote the set of all pure states by 

P{C):={p^C\p^=p} (11) 

This set is in correspondence with the rays of Ti. 
via the association 



F:C¥{U)^C I [IV.)] ^ |^)(^|, (12) 

where CP(H) is the projective space of % and 
Wi})] is the class defined by the vector jVi) {\tf) ^ 
v.) < — > = AjV"), A ^ 0). If M represents an 
observable, its mean value (Af) is given by 

tr(pM) = (M) (13) 

Notice that the set of positive operators has the 
shape of a cone while the set of trace class oper- 
ators (of trace one) that of a hiperplane. Thus, 
C is the intersection of a cone and a hiperplane, 
embbeded in A. Such structure (or geometrical 
convex setting) is susceptible of considerable gen- 
eralization (see 0-13] for an excellent overview). 
In modeling probabilistic operational theories one 
associates to any probabilistic system a triplet 
(A", I],p), where S represents the set of states of 
the system, X is the set of possible measurement 
outcomes, and p : A x E i— [0, 1] assigns, to each 
outcome x & X and state s S S, a probability 
p(x, s) of X to occur if the system is in the state 
s. If we fix s we obtain the mapping s i— ^ p{- • ■ , s) 
from S — !■ [0,1]^. We then identify in this way 
all the states of S with maps of such a form. Fo- 
cusing now attention upon their closed convex hull 
we obtain the set Q of possible probabilistic mix- 
tures (represented mathematically by convex com- 
binations) of states in E. One appreciates that 
we also obtain, for any outcome x S A, an affine 
evaluation-functional /a; : 17 — [0,1], given by 
fx{ct) = a{x) for all a e 17. More generally, any 
affine functional f : ^ [0,1] may be regarded as 
representing a measurement outcome and thus use 
/(a) to represent the probability for that outcome 
in state a. 



A. Effects 

In the special case of quantum mechanics the set 
of all affine functionals so-defined is called the set 
of effects. They form an algebra (known as the 
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effect algebra) and represent generalized measure- 
ments (unsharp, as opposed to sharp measures de- 
fined by projection valued measures). Effect al- 
gebras have important applications in the founda- 
tions of quantum mechanics 36] and in fuzzy prob- 
ability theory [21]. The specifical form of an effect 
in quantum mechanics is as follows. A general- 
ized observable or positive operator valued measure 
(POVM) will be represented by a mapping 

E : B(M) B{U) such that 

1. E{M) = 1 

2. E{B) > 0,, for any B G B(R) 

3. E{Uj{Bj)) = Y.jE{Bj), for any disjoint 
family Bj 

The first condition means that E is normalized to 
unity, the second one that E maps any Borel set B 
to a positive operator, and the third one that E is 
fj-additive with respect to the weak operator topol- 
ogy. In this way, a POVM can be used to define 
a family of affine functionals on the state space C 
(which corresponds to J7 in the general probabilis- 
tic setting) of quantum mechanics, as follows 



E{B) : C [0,1] 

p ^ tT{Ep). (14) 

Effects are then positive operators E{B) which sat- 
isfy <£;< 1 lig). Let us denote by £{H) 
to the set of all effects in quantum theory. We 
appeal to effects below in order to define an spe- 
cial example of elements of Cc, and also as a gen- 
eralization of conditions imposed in the Max-Ent 
protocol. Returning now to the general model of 
probability states we may consider the convex set 
as the basis of a positive cone V+(f2) of the linear 
space V(fl). Thus, every affine linear functional 
can be extended to a linear functional in V{n)* 
(the dual linear space) . It can be shown that there 
is a unique unity functional such that UQ{a) = 1 
for all a £ (in quantum mechanics, this unit 
functional is the trace function). Thus, the COM 
approach speaks of a triplet {A, A"^ ,ua), where A 
is a space endowed with a strictly positive linear 
functional ua and A' is a weak-* dense subspace 
of A* , ordered by a chosen regular cone A{ c Al 
containing ua- Effects will be functionals / in A\_ 
such that f < UA- 



IV. A GEOMETRICAL EXPRESSION FOR 
MAX-ENT 

Our idea is to re-discuss MaxEnt in terms of ele- 
ments of Cc associated to conditions on given sets 
of observables or effects. Consider the states 

C^E,>.) := {P e C I tiipE) = A, A e [0, 1]}. (15) 

C^; is a convex set, and so, an element of Cc- 
C{E,x) , represents all the states for which the prob- 
ability of having the effect E is equal to A. Fur- 
thermore, there exists §, a M-subspace of A (the 
set of bounded self adjoint operators), such that 

C(E,A) = §nc (16) 

and thus, is also an element of C, the lattice 
induced by the intersection of all closed subspaces 
of A and C i3^ ■ More generally, if 

(i?) = r (17) 

then the above equation may be considered as rep- 
resented by the set of density matrices which serve 
as a solution of it. The ensuing set is obtained 
as the intersection of the Kernel of the functional 
Fr{p) '-— tT:{Rp) — rtr(p) and C. Accordingly, each 
equation of the form (|17p (understood as an equa- 
tion to be solved) can be represented as an element 
C G £, and also as an element oi Cc- C is also a 
closed set, because it is the intersection of the ker- 
nel of a functional (which is a closed subspace) and 

c poj. 

With such materials at hand, we can now re- 
express the maximum entropy principle [2', in 
lattice theoretical form. Our point here is that the 
set of conditions (QP can be expressed in an explicit 
lattice theoretical form as follows. Using a similar 
procedure as in p?| we conclude that each of the 
equations in ([1} can be represented as a convex 
(and closed) sets Cn- . In this way we can now 
express conditions H]) with the lattice theoretical 
expression 

i i 

Now, Cmax-ent IS also an element of Cc (but 
not necessarily of C) and we must maximize en- 
tropy on Cmax-ent- We havc thus encountered 
a MaxEnt-lattice theoretical expression: given a set 
of conditions represented generally by convex sub- 
sets Ci, one should maximize the entropy in the set 

Cmax-ent — /\j Ci- 
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V. GENERALIZATION 

A (generalized) observable in a test space ft will 
be given by a function F : x i-^ from subsets of 
a given outcome set X into A{rt) satisfying 

1. > 

2. j:.eEF^ = ^ 

This is the natural extension of the notion of 
POVM to any COM (extension which includes the 
more restricted case of projection operator valued 
measures for the quantum case). If w S f2, we 
can construct the probability function Puj.f{x) = 
Fxioj), and this pulls back a map F* : — > A(F), 
with F*{u]) = Puj.F- With this at hand, we can eas- 
ily generalize probabilities (and so, when they ap- 
pear, mean values) as linear conditions. With this 
procedure we will obta in c onvex sets, and proceed 
similarly as in Section IIVI For example, suppose 
that the outcomes of our observable F are repre- 
sented by the discrete set of real numbers {/i}igN. 
Then we can write the mean value of F in the state 
LO as: 

{F)^ = j2mM (19) 

i 

The probability functions Ff.{-) are linear opera- 
tors defined on A taking values in the interval [0, 1] 
when restricted to states. As they are linear, we 
can define the functional 

(F) : A -> R I (F) (a) ^ ^ f.Fj^ (a) (20) 

i 

If we now consider the new functional 

{F)r : A ^ M I (F),(a) ^ ^ /,F/, (a) - ™(a) 

(21) 

then, the Kernel of (F)^ will be a linear subspace 
of A, call it Sr^F- If we now restrict to the ele- 
ments of fl (and any uj € Q satisfies u(w) = 1), we 
will have that solutions of the Equation [12] can be 
represented with the convex set 

Cr,F := §r,F H Q (22) 

More generally, even if our measurement outcomes 
are just labeled by an index set and we are not 



interested on mean values but only on probabili- 
ties (as is generally the case for many POVM's), 
conditions will have the form 



Pu:A^)=PA^)=C^ (23) 

and following an analogous reasoning line as above, 
it can also be put in the form Sa^F H fl, with Sa^F 
a subspace which depends on the real number a 
and the observable F. 

In any case, the construction given above provides 
the path for ge nera lization of the procedure out- 
lined in Section IIVI to any COM. If Ei represent 
observables and the brackets (•) are meant to ex- 
press either conditions of the form of Equations [T^ 
or [231 suppose as given a set of conditions of the 
form 



(Fj) = e,; for aU i. (24) 

Then, because of the above discussion, the set of 
conditions [Ml may be expressed as a collection of 
convex subsets of the form Ce^ = Sg^ H fi. And 
the Jaynes method tells us that we must maximize 
entropy on the convex set: 



CMaxEnt — /\(Se. n VL) (25) 



It is important to remark here that our construc- 
tion does not only restricts to projective measure- 
ments, but it includes the possibility of imposing 
conditions on POVMs. Thus, we provide here a 
generalization of the Max Ent protocol for gener- 
alized measurements. 

We notice that the specific form of the entropy to 
maximize depends on the specifical COM which is 
being used. For example, for the particular cases 
of quantum theory and a classical model, von New- 
mann and Shannon entropies are used respectively 
in a natural way. The election of the particular 
function to maximize on CMaxEnt, does not de- 
pends on the general formulation but in the specif- 
ical characteristics of the model. An interesting 
question would be to set up general conditions for 
entropies in any model, but the existence of such 
conditions is hard to believe, because of the prolif- 
eration of entropies and contexts. 



VI. CONCLUSIONS 

In this work we reviewed the celebrated E. T. 
Jaynes max-ent principle. After that, we studied 
generalizations of probabilistic models, the COM 
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approach. In Section IIVI we gave a new expres- 
sion for max-ent using a lattice theoretical fash- 
ion, expressing conditions as convex sets and tak- 
ing the maximum in their set theoretical intersec- 
tion, i.e., lattice conjunction. In Section |Vl we 
used the key fact that the probability function of 
COM preserves convexity in order to link the COM 
approach with the results of Section IIVI and gave 
a generalization for max-ent. This generalization 
also includes a max-ent protocol for conditions on 
POVMs in any COM. This kind of generalizations 



may be useful to extend the powerful max-ent ap- 
proach for more general theories and also yields 
light into its mathematical and geometrical struc- 
ture/background. 
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